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Figure 3 



310 

Receive a plurality of first coefficients and a plurality of 
second coefficients, a first quantization step size, a second 
quantization step size, and a quantization operation. 

i 



320 

Performing the quantization operation for a first coefficient 
of the plurality of first coefficients and a second coefficient 

of the plurality of second coefficients, the quantization 
operation based on the first quantization step size and the 
second quantization step size. 



i 

330 

Determine whether the first coefficient is responsive based 
on the quantization operation. 




Yes 



No 



350 

Generate a coefficient responsiveness table comprising a 
distribution of responsiveness of the plurality of first 
coefficients for the first quantization step size. 



Figure 4 



Set ail possible 
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unresponsive 



Start from 1hB Jirst possible interval. j=1 . 
between L, (right side of (6)) and U i fleH side 
ot (6» 



IfO* 



Slart Irom lha first 
possible coefficient 
value. i=1 



til 




Try nexl possible 
coefficient, i=i+1 




• yes* 



no 



1 



Try next possible interval, 
between Lj + , and U |H 




Figure 5A 
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Figure 5B 
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Figure 7 
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Figure 8 



810 

! Receive an input quantization step size and a plurality of 
coefficients of a macroblock or a group of macroblocks 
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820 

Determine a magnitude distribution of non-zero coefficients 
of the plurality of coefficients 


1 
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830 

Determine a plurality of candidate quantization step sizes 
based on a first table 
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840 

Determine a quantization error for a range of quantization 
step sizes including the input quantization step size 


1 


r 



850 

Select a plurality of candidate quantization step sizes from the 
range of quantization step sizes wherein the plurality of 
candidate quantization step sizes produce a quantization 
error not greater than quantization error associated with the 
input quantization step size. 

i 

860 

Determine the optimal quantization step size from the 
plurality of quantization step sizes based on a second table 



